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(57) Abstract 

A machine vision system (20) color camera is 
calibrated via two algorithms. Separate red, green 
and blue image gray level histograms (44) in a cal- 
ibration target (40) are utilized to generate corre- 
sponding standard cumulative probability functions 
(46). The probability functions and a target copy 
is provided to the system. Repeating the above 
steps (48) result in comparing cumulative probabil- 
ity functions are compared to corresponding stan- 
dard cumulative probability functions (50) to obtain 
red, green and blue channel gains of the uncalibrated 
camera (52). In a second calibration algorithm, a 
target patch of pure white is observed (70, 72) while 
determining camera outputs for red, green and blue 
(74). The average gain for each output channel of 
the color camera is determined (76). The calculated 
average white level value for each channel is di- 
vided into the full scale value of the uncalibrated 
vision system. The three gain factors of either algo- 
rithm applied to a subsequent image yields a color- 
corrected image (52, 78). 
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METHOD AND SYSTEM FOR 
AUTOMATICALLY CALIBRATING A COLOR 
CAMERA IN A MACHINE VISION SYSTEM 

Cross-Reference To Related Applirafinn 

This application is related to U.S. patent 
application entitled "Method and System for Automatic- 
ally Monitoring the Color of an Object at a Vision 
Station", filed on the same date as the present applica- 
tion. 

Technical Field 

This invention is related to methods and 
systems for automatically calibrating color cameras such 
as RGB cameras and, in particular, to methods and 
systems for automatically calibrating color cameras in 
machine vision systems. 

Background Art 

The fidelity of an image taken using a color 
camera relies on several factors, such as quality of the 
camera and lens, uniformity of the illumination, the 
color of the illumination (color temperature) , the 
relationship between the intensity of the light corre- 
sponding to the red, green and blue (i.e., R, G and B) 
components of the image and the signal output from the 
camera on the relevant channels (i.e., color gains). 

Compared with other types of color sensors, 
even the best high resolution color television cameras 
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make poor color monitoring systems. Conventional 
colorimeters and densitometers essentially monitor spot 
or local colors, and do so with a rigorously controlled 
light source and often with only one light sensor 
5 connected to precision calibrated electronics. 

A color camera by contrast observes a large 
area of an object within the order of 1 million or more 
independent detector elements, being fed into three 
independent color channels corresponding to the red, 
green and blue regions of the spectrum. Invariably, 
these channels are equipped with manual gain adjustments 
so that the resulting picture can be set up to produce 
a subjectively pleasing image on the monitor. In 
addition, the colors reflected from the object being 
observed are directly modified by the color temperature 
of the illumination source, an effect that the untrained 
human eye is very insensitive to do. 

Thus, when using a color camera as a color 
measurement tool rather than a simple component in a 
20 remote image transfer mechanism, characteristics that 
are largely irrelevant in the latter mode now become 
vitally important. 

Consequently, any color comparison operation 
requires precise control of the image illumination, both 

25 in intensity and color, and also requires a very diffi- 
cult camera set-up operation to ensure that all cameras 
undertaking the comparison operation are set up in an 
identical fashion, and are totally free from electronic 
drift. Despite the above-mentioned drawbacks, a color 

30 camera augmented by a fast image processing system 
offers fast area color comparisons in product ion -type 
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environments that are virtually impossible using any of 
the more conventional color measurement techniques. 
However, vitally important to achieving any of the 
promised potential, the system has to be able to over- 
come the changes in hue due to modifications to color 
temperature of the illumination, due to perhaps power 
fluctuations, or replacement of light sources, etc. 
Since no two color cameras give color images that are 
exactly the same, to make any system viable it must be 
possible to interchange any color camera with an identi- 
cal unit without the requirement for adjusting the 
individual channel gains manually in an attempt to 
compare an image taken on this system with a template 
that has perhaps been captured on a totally different 
system whose camera may be set up with a totally differ- 
ent set of gains. 

The U.S. patent to Haruki et al . (5,442,408) 
is entitled "White Balance Adjusting Apparatus for 
Automatically Adjusting White Balance in Response to 
Luminance Information Signal and a Color Information 
Signal Obtained Prom Image Sensing Device." A color 
evaluating value correcting circuit determines whether 
the color evaluating values are within a predetermined 
color temperature distribution range. if not, adjust- 
ments are made to automatically bring these values 
within the desired range. Gain control circuits control 
the gains of the amplifying circuits so that picture 
color evaluating values are normalized. 

The U.S. patent to Dozier et al . (5,202,767) 
is entitled "Multimode Computerized Multicolor Camera 
and Method Therefor." The system described therein has 
the following features: 1) a computerized multicolor 
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camera operates over a wide range of light levels; 2) 
there is an exact frame- to-frame registration of all 
colors of the multi-color image of a defined object 
without pixel jitter; 3) irregularities in the image 
5 sensor (the camera) are compensated for. The computer 
control for this device is internal. Digital represen- 
tation of images are generated by the camera at the 
three primary colors (red, green and blue) . An amplifi- 
cation and designation circuit allows for the photomet- 
10 ric compensation of the uncompensated pixel values using 
a compensation table and allows for the storage of a 
compensated digital signal representation of an image in 
digital memory. 

The U.S. patent to McCauley (5,363,318) is 
15 entitled "Method and Apparatus for Adaptive Color 
Characterization and Calibration." A device described 
therein functions to provide a system which independent- 
ly corrects the color channels by providing independent 
color correction curves which together are constrained 
20 to provide a color balanced response. In addition, this 
system simultaneously corrects for saturation effects 
and linearizes device response in an effort to utilize 
the entire dynamic range of the sensing device. A 
typical system as envisioned in the primary embodiment 
25 will utilize a personal computer such as an IBM or an 
Apple. 

The U.S. patent to Tanabe (5,327,226) is 
entitled "Method and System for Automatically Adjusting 
Color Balance of a TV Camera." The device described 
30 therein provides for an automatic color setup system in 
which a white level, a black level, and a grey level are 
determined by analysis of image signal data derived from 
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a standard image. These values are supplied to a CPU 
through a buffer memory. The CPU includes a division 
processing section, an adequate block selecting section, 
a measurement region determining section and a color 
balance adjusting section. 

The U.S. patent to Nishiyama et al . 
(5,293,225) is entitled "Digital Signal Processing 
System for a Color Camera Apparatus Including Separate 
Delays for Color Signal and Brightness Signal Process- 
ing." An auto signal processing circuit receives 
presently processing signal amplitude data from a 
brightness signal processing circuit and a color signal 
processing circuit, and outputs system control data to 
a micro computer via a data bus. 

The U.S. patent to Lehr (5,159,185) is enti- 
tled "Precise Color Analysis Apparatus Using Color 
Standard." Digital signals are sent to a computer which 
first averages the output signals of the camera in each 
of the color channels for that portion of the camera 
output signal which represents the location of the 
standard tile, and then compares at least one of the 
averaged camera signals to information in the computer 
memory which has been derived from previous readings for 
the standard tile. If the average camera signal does 
not match the information in the computer memory, the 
computer sends signals to the lamp control circuit which 
adjusts the lamp output to the appropriate direction and 
amount until the averages camera signal information is 
matched. 

The U.S. patent to Kawada et al . (5,179,437) 
is entitled "Apparatus For Color Correction Of Image 
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Signals Of A Color Television Camera." A CPU compares 
an image signal obtained by processing a pick up signal 
with an image signal from the test chart signal -gener- 
ating circuit. A color correction circuit takes the 
5 results and makes the appropriate corrections. 

The U.S. patent to Webb et al. (5,216,504) is 
entitled "Automatic Precision Video Monitor Alignment 
System." A pickup camera transmits a digital signal to 
a calibration computer via a video coprocessor subsys- 

10 tern. This system functions to precisely align all the 
adjustable display characteristics of a video monitoring 
system. To allow for accurate tracking of color temper- 
ature at any brightness or contrast setting, 12 adjust- 
ments are made for each desired color temperature. 

15 These are divided into four (4) groups for each color 
(red, green and blue) : Brightness Maximum, Brightness 
Minimum, Contrast Maximum and Contrast Minimum. The 
amount of each is precisely set for the proper color 
temperature . 

20 Summary Of The Invention 

An object of the present invention is to 
provide a computer-controlled method and system for 
calibrating a color camera such as a RGB camera wherein 
any measurement taken by the camera is independent of 
25 both the color temperature of any illumination, and the 
gain settings of the camera RGB sensors. 

Another object of the present invention is to 
provide a computer-controlled method and system for 
calibrating a color camera such as a RGB camera wherein 
30 the computer determines a set of constants derived by 
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observing a standard image and wherein a set of con- 
stants essentially equalize all color camera/light 
source combinations, without the need for any but the 
most rudimentary camera set-up. 

Still yet another object of the present 
invention is to provide a computer-controlled method and 
system for calibrating a color camera such as a RGB 
camera wherein a master image is presented to the 
camera, consisting of known colors and wherein the 
output image of the color camera is compared to the 
known master, upon which gains offsets and look up table 
data are generated. 

In carrying out the above objects and other 
objects of the present invention, a method is provided 
for automatically calibrating a color camera having 
output channels in a machine vision system. The method 
includes the steps of providing an initial set of 
calibration data and a calibration target having a pure 
white region and utilizing the color camera to generate 
a target image containing the target with the pure white 
region for each of the output channels. The method 
further includes the step of measuring an output of each 
of output channels during the step of utilizing to 
obtain output measurements. Finally, the method in- 
cludes the step of computing a final set of calibration 
data to calibrate the camera in the machine vision 
system from the output measurements and the initial set 
of calibration data. 

Further in carrying out the above objects and 
other objects of the present invention, a system is 
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provided for carrying out each of the above -noted method 
steps . 

The above objects and other objects, features, 
and advantages of the present invention are readily 
5 apparent from the following detailed description of the 
best mode for carrying out the invention when taken in 
connection with the accompanying drawings. 

Brief Descriptio n Of The Drawin gs 

FIGURE 1 is a schematic diagram illustrating 
10 a machine vision system and station at which the method 
and system of the present invention can automatically 
calibrate a color camera thereof; 

FIGURE 2 is a block diagram flow chart illus- 
trating a calibration algorithm of the present inven- 
15 tion; 

FIGURE 3 is a "gray level" histogram taken of 
resulting red, green and blue images in a "well adjust- 
ed" machine vision system; 

FIGURE 4 is a graph of a cumulative probabili- 
20 ty function generated from the histogram of Figure 3; 

FIGURE 5 is a graph of a "gray level" histo- 
gram taken of resulting red, green and blue images in a 
system requiring calibration; 



FIGURE 6 is a graph of the cumulative proba- 
25 bility function of Figure 4 together with a graph of the 
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cumulative probability function generated from the 
histogram of Figure 5; and 

FIGURE 7 is a block diagram flow chart illus- 
trating a simplified calibration algorithm of the 
5 present invention. 

Best Modes For Carrying Out Th* TnvpnHnn 

Referring to the drawing Figures, there is 
illustrated schematically in Figure 1, a machine vision 
system and station, generally indicated at 20, by which 
the method and system of the present invention can 
automatically calibrate a color camera such as a RGB 
camera therein. While RGB cameras are most widely used, 
the method and system of the invention could also be 
used with cameras having other types of channels such as 
15 Cyan, Magenta and Yellow channels. 

The machine vision system 20 typically in- 
cludes an image digitizer/frame grabber 22. The image 
digitizer/frame grabber 22 samples and digitizes input 
images from an image source such as a camera 24 and 
places each input image into a frame buffer having 
picture elements. Each of the picture elements may 
consist of an 8 -bit number representing the brightness 
of that spot in the image. A digital camera 25 may be 
provided to eliminate the need for the image digitiz- 
25 er/frame grabber 22. 

The system 20 also includes input/output 
circuits 30 to allow the system 20 to communicate with 
external devices such as a controller for controlling an 
offset printing machine (not shown) . 



20 
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The camera 24 may be an image source such as 

an analog, digital or line scan camera such as RS-170, 
CCIR, NTSC and PAL. 

The system bus 26 may be either a PCI an EISA, 
5 ISA or VL system bus or any other standard bus to allow 
inter- system communication such as at a monitor 29 of 
the system 20. 

The image digitizer/frame grabber 22 may be a 
conventional frame grabber board such as that manufac- 
10 tured by Matrox, Cognex, Data Translation or other frame 
grabbers. Alternatively, the image digitizer/frame 
grabber 22 may comprise a vision processor board such as 
made by Cognex. 

The machine vision system 20 may be programmed 
15 at a mass storage unit 32 to include custom controls for 
image processing and image analysis. Examples of image 
processing may include linear and non-linear enhance- 
ment, morphology, color and image arithmetic. Also, 
image analysis may include search, edge, caliper, blob, 
20 template, color, 2-D and 3-D measurements. 

A computer 28 of the system 20 may be a 
Pentium-based IBM compatible PC or other PC having a 
sufficient amount of RAM and hard disk space for per- 
forming the calibration algorithms associated with the 
25 present invention. 

An image of the present invention can be 
thought of as consisting of three components or sub- 
images. These images are essentially monochrome. These 
images correspond to the red, green and blue components 
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of the colored image. The actual physical object 
forming the image consists of regions where the amount 
of the incident light of each color reflected from, or 
transmitted through the object essentially changes, thus 
5 providing the image detail. It is this change in 
reflectance (or transmittance) that provides valuable 
information. However, the information that the computer 
28 receives is somewhat diluted. It consists of the 
product of the ref lectance/transmittance of the point, 

10 the intensity of the illumination at that point, the 
amount of light allowed through the lens (i.e. f stop of 
the lens) , the sensitivity of the sensor in the CCD 
array, and finally the gain of the following electron- 
ics. Subject to these parameters staying stable over a 

15 short period of time, the signal obtained is directly 
proportional to the desired signal. However, the major 
problem is that the constant of proportionality varies 
between the red, green and blue channels. It is this 
coefficient that the calibration method and system of 

20 the present invention normalizes. 

A calibration algorithm of the method and 
system is first described generally hereinbelow. Then, 
another version of the algorithm, significantly simpli- 
fied for speed, is described. 

25 Referring now to Figure 2, there is illustrat- 

ed in block diagram flow chart form, a step at block 40 
of showing a calibration target to a typical "well 
adjusted" machine vision system. The only requirement 
for the calibration target is that the red, green and 

30 blue components of the image have a representative 
distribution. In other words, calibration cannot be 
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accomplished using a calibration image having zero 
energy in one or more color channels. 

At block 42, the illumination and aperture of 
the camera 24 must be adjusted so that the resulting 
5 image fills the dynamic range of the system without 
. sending it into saturation in any part of the image. 

At block 44, a "gray level" histogram is 
generated for the resulting red, green and blue images. 
One such histogram could well look like the one in 
10 Figure 3 . 

At block 46, this data is used to generate a 
standard cumulative probability function which is shown 
in Figure 4 . 

The cumulative probability is effectively the 
15 normalized integral of the original histogram, and is 
defined as: 

X 

Cumulative__Histogzam x = £ Histogram n 

Cumul ati ve^Jii stogram n 

CPF ■ 

n Cumulative^Histogxam 

One would have three of these cumulative 
probability maps - one for each channel. These are 
important to the calibration procedure and would be 
20 provided to every machine vision system needing calibra- 
tion together with a high quality copy of the calibra- 
tion target. 
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At block 48, calibration is achieved by 
repeating the above-noted process on the system requir- 
ing calibration. The resulting histogram of this 
process for one channel (in much exaggerated form) is 
shown in Figure 5 . 

At block 50, the cumulative probability 
function from this histogram is compared with the 
standard cumulative probability function to obtain the 
graph of Figure 6 . 

The latter histogram is more "squashed" 
because either the illumination isn't as bright, the 
aperture is wrongly set, or the gain of this particular 
channel is differently adjusted or a combination of the 
above. The correction factor or gain for this particu- 
lar color channel is computed which will equalize the 
calibration image taken on the original machine with the 
new one image. Since one is looking at an identical 
object in both cases, then the two cumulative probabili- 
ty functions should exactly overlay. The fact they 
don't means one needs to compensate. One does this by 
adding horizontal lines and determining where they cross 
the two curves, such as is shown by the line intercept- 
ing the new curve at VI and the original curve at V2. 
The gain is computed as: 




This process can be repeated for as many points as one 
likes to obtain a good average gain. 

The process yields three values for the gain. 
The first value is for the red channel. The second 
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value is for the green channel and the third value for 
the blue channel. 

At block 52, these gains can then be applied 
to any further image coming into the system, leaving one 
5 confident that the resulting image will, at least as far 
as color balance is concerned, be identical to the 
results taken on the original adjusted system. 

Often there may be a situation where the 
calibration needs to be done on a per image basis, 

10 rather than undertaken on a one-off procedure. Refer- 
ring to Figure 7, there is illustrated in block diagram 
flow chart form , the same algorithm in a much simpli- 
fied form. One effectively "invents" a hypothetical 
standard machine, and present this with an imaginary 

15 reference image consisting of a pure white object. The 
results that one gets, of course, is that each channel 
of this machine will produce exactly full scale (proba- 
bly 255 for 8 bit arithmetic) . 

Now, if one includes somewhere in the image of 
20 a real operating system a target patch of pure white 
(i.e. block 70), then providing one can identify this 
patch (i.e. block 72) and determine the camera output 
for R, G and B while observing it (i.e. block 74) one 
can find the average gain for each of the channels. 
25 This essentially simplifies to taking the average white 
level measured for each of the channels and dividing 
this into 255, or whatever the full scale value of the 
numbering system represents (i.e. block 76) . Applying 
these three gain factors to the complete image, one ends 
30 up with a color corrected image (i.e. block 78) . 
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In other words, at block 74, the average 
intensity of the white region of interest is measured 
for the red, green and blue channels of the camera 24. 
At block 76, the individual gains are then computed as: 



y green 
Ybiue 



255 

255 
P green 
255 
Vblue 



Here, y are the gains and /i are the mean values for the 
white calibration area. 

At block 78 , the complete image of the cali- 
bration target is processed by multiplying by the 
relevant gain as shown below: 

Corrected Image rgtH = Imaae ^ • v 

Corrected Image nrmmn = imae • v 

— * 9reen row coiumtt yc green reMeoluatn T green 

Corrected Image hltl „ = Imaae^ * v 



10 While the best mode for carrying out the 

invention has been described in detail, those familiar 
with the art to which this invention relates will 
recognize various alternative designs and embodiments 
for practicing the invention as defined by the following 

15 claims. 
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What Is Claimed Is : 

1. A method for automatically calibrating a 
color camera having output channels in a machine vision 
system, the method comprising the steps of: 

5 providing an initial set of calibration data 

and a calibration target having a pure white region; 

utilizing the color camera to generate a 
target image containing the target with the pure white 
region for each of the output channels; 
10 measuring an output of each of the output 

channels during the step of utilizing to obtain output 
measurements; and 

computing a final set of calibration data to 
calibrate the camera in the machine vision system from 
15 the output measurements and the initial set of calibra- 
tion data. 

2. The method as claimed in claim 1 further 
comprising the steps of: 

providing the calibration target to a adjusted 
20 machine vision system including a second color camera 
having output channels; 

generating a calibration image from each 
output channel of the second color camera from the 
calibration target; and 
25 generating the initial set of calibration data 

based on the calibration images. 

3 . The method as claimed in claim 2 wherein 
the initial set of calibration data includes a first set 
of cumulative probability functions based on the cali- 
30 bration images. 
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4 . The method as claimed in claim 3 wherein 
the step of computing includes the steps of generating 
a second set of cumulative probability functions corre- 
sponding to the target images and comparing the first 
5 and second sets of cumulative probability functions to 
obtain the final set of calibration data. 

5. The method as claimed in claim 1 wherein 
the color camera is a RGB color camera. 

6. A system for automatically calibrating a 
10 color camera having output channels in a machine vision 

system, the system comprising: 

means for storing an initial set of calibra- 
tion data; 

providing a calibration target having a pure 
15 white region; 

means for generating a target image containing 
the target with the pure white region for each of the 
output channels; 

means for measuring an output of each of the 
20 output channels to obtain output measurements; and 

means for computing a final set of calibration 
data to calibrate the camera in the machine vision 
system from the output measurements and the initial set 
of calibration data. 

25 7. The system as claimed in claim 6 further 

comprising: 

an adjusted machine vision system including a 
second color camera having output channels, the adjusted 
machine vision system including means for generating a 
30 calibration image from each output channel of the second 
color camera from the calibration target and means for 
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re- 
generating the initial set of calibration data based on 
the calibration images. 

8. The system as claimed in claim 7 wherein 
the initial set of calibration data includes a first set 

5 of cumulative probability functions based on the cali- 
bration images. 

9 . The system as claimed in claim 8 wherein 
the means for computing includes means for generating a 
second set of cumulative probability functions corre- 

10 sponding to the target images and means for comparing 
the first and second sets of cumulative probability 
functions to obtain the final set of calibration data, 

10 . The system as claimed in claim 6 wherein 
the color camera is a RGB color camera. 
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PROVIDE CALIBRATION TARGET HAVING 
SAMPLES OF RED, GREEN, AND BLUE THEREIN 



I 



40 
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